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I.  INTRODUCTION 


Background  Information 

efforts  to  'Lrolenent  ;H'.ality  assurance  programs  are  hindered  by 
difficulties  in  the  conceptaalization,  measurement  and  assessment  of  quality 
in  the  provision  of  health  care.  Any  attempt  to  define  quality  of  care 
orcduces  as  rany  responses  as  there  are  providers,  administrators  and 
ancilian/  support  personnel.  Failure  to  accurately  define  quality  care 
results  in  disagreements  regarding  aoprooriate  approaches  to  its  measurement, 
ind  the  selection  of  the  necessary  statistical  tool.  Most  institutions 
v^annot  resolve  these  differences  prior  to  iinplementing  a  quality  assurance 
plan.  Instead,  the  typical  plan  represents  a  rational  response  to  wevailinq 
resource  and  behavioral  constraints  existing  within  the  health  care 
environment.  Assessment  of  patient  care  is  a  necessary  component  of  any 
quality  assurance  program.  Health  care  providers  may  be  reluctant  to 
participate  or  even  actively  oppose  the  .assessment  of  provider  [performance. 
Common  barriers  to  provider  support  are  opposition  to  change,  fiscal 
constraints  and  autonomy  expectations  of  health  care  professionals.^ 

Participation  by  physicians  in  the  quality  assurance  process  is 
critical  to  the  success  of  the  prograim.  Several  motivations  exist  for 
physician  participation.  Physicans  ace  concerned  about  quality  of  (cire. 
Most  are  motivated  by  a  strong  desire  to  help  people  and  the  provision  of 
quality  care  fulfills  this  need.  Preservation  of  the  respectability  of  tlie 
medical  profession  collectively,  and  as  it  impinges  upon  one's  own  practice, 
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forms  a  second  reason  to  support  quality  assurance.  Finally,  economic 
rnotivations  exist  because  the  individual's  right  to  practice  and  the 
institution's  charter  depend  upon  a  social  contract  that  nanimum  standards  of 
care  will  be  achieved.  Hie  factors  v^ich  favor  physician  involvement  in  the 
quality  assurance  process  are  opposed  by  practical  considerations.  Time 
constraints,  concerns  regarding  the  fairness  of  the  review  orocess  and  fears 
of  peer  retribution  mitigate  against  physician  involvement. 2 

The  health  care  administrator  should  play  a  forceful  role  in  the 
development  and  evaluation  of  institutional  standards,  including  those 
dictating  quality  of  care.  Any  acceptable  system  of  quality  control  must 
include  the  following  coiTTponents:  "1.  Definition  of  the  outcomes  sought  in 
the  medical  care  process;  2.  formulation  of  criteria  by  professionals;  3. 
conversion  of  outcome  criteria  into  numerical  scores  to  permit  machine 
processing;  and  4.  experimentation  to  improve  prediction  of  outcome,  use 
of  data  and  refinement  of  the  total  quality-control  system."^ 
Institutional  performance  is  best  measured  by  an  organization's  ability  to 
meet  predetermined,  formally  expressed  objectives;  however,  the  Ixjspital 
administrator  has  too  often  abdicated  responsibility  for  setting  quality 
control  standards.  The  hospital  is  no  longer  immune  to  the  growing  public 
demand  for  accountability.  Rampant  health  care  costs  and  increased  customer 
awareness  have  contributed  to  the  development  of  stringent  expectations 
regarding  the  performance  of  health  care  providers  and  the  operation  of 
medical  treatment  facilities  (MTFs).  The  administrator  must  participate  in 
the  process  to  measure  the  hospital's  compliance  with  valid  expectations.”^ 

The  perceived  failure  of  military  hospitals  to  meet  community 
expectations  of  care  has  resulted  in  costly  malpractice  litigation.  One  of 
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the  earlier  cases  to  achieve  media  notoriety  involved  Colonel  William 
Stanford,  former  chief  of  cardiac  surqery  at  Wilford  Hall  Medical  Center, 
Lackland  Air  Force  Base,  San  Antonio,  Tfexas.  In  May  1978,  Colonel  Stanford 
was  servinq  on  the  staff  of  Lutheran  Hospital  in  Milwaukee,  Wisconsin  in  a 
civilian  re-education  oroqram.  Colonel  Stanford  incorrectly  hooked  up  the 
heart-lung  machine  and  this  mistake  caused  the  patient  to  suffer  brain  dant'ge 
which  left  her  as  a  quadraplegic  mthout  speech.  Ironically,  the  coronary 
'o',vT)ass  orocedure  was  successful.  The  chief  surqeon  settled  the  malpractice 
case  out  of  'COurt  for  3575,000.  Tne  Air  Force,  on  Stanford's  behalf, 
contested  the  suit.  Resultant  testimony  revealed  a  pattern  of  apparently 
substandard  care  nrovided  by  Colonel  Stanford  while  assigned  at  Wilford  Hall 
Medical  Center.  Forty-three  percent  of  Stanford's  ratients  died  during  or 
immediately  after  tlteir  operations.  Two  anesthesiologists  refused  to  assist 
Stanford  despite  a  1978  Air  Force  evaluation  which  rated  Lhe  surqeon  as  fully 
aualified.  'lhe  defense  attempted  to  argue  that  Colonel  Stanford  performed 
surqery  on  the  nost  serious  cases  and  tnat  the  extremely  poor  health  of  his 
patients  prior  to  surgical  intervention  contributed  significantly  to  the  high 
mortality  rate.  This  argument  '^s  ineffective  and  a  $1.8  million  award  was 
rendered  on  behalf  of  the  complainants. Rising  litigation  costs  and 
continued  media  scrutiny  have  highlighted  a  need  to  continue  to  assess  the 
quality  of  patient  care  rendered  at  military  hospitals.  As  a  reaction  to 
growing  public  demand,  the  Assistant  Secretary  of  Defense  for  Health  Affairs 
has  published  the  Department  of  Defense  (DoD)  Directive  6025.1,  subject; 
"Standards  for  DoD  Health  Care  Provider  Performance,"  dated  19  April  1983. 
Each  military  department  has  been  directed  to  prescribe  mortality  and 
complication  rate  norms  against  vhich  the  performance  of  DoD  health  care 


4 


providers  may  be  assessed.  Under  the  provisions  of  this  directive,  ^TTF 
conronders  are  reauired  to  establish  procedures  for  reviewing  all  cases 
involving  deaths  and  complications  and  for  canouting  the  mortality  and  the 
complication  rates  for  all  providers  assigned  to  the  facility.  The  record  of 
eacn  DoD  health  care  orovider's  .mortality  and  complication  rates  will  be  the 
subject  of  annual  review  by  toe  liospital  credentials  committee  and  results  of 
this  review  will  be  maintained  in  the  provider's  credentials  file.  At  the 
conclusion  of  each  calendar  vear  (CY) ,  the  ‘TTF  commander  is  required  to 
forward  a  report  sammarizing  the  ;mortality  and  complication  rates  for  the 
hospital  through  toe  Office  of  the  Surgeon  General  to  the  Department  of 
Defense.  This  report  identifies  the  namber  of  providers  exceeding 
established  thresholds  and  details  corrective  actions  taken  when  deemed 
necessary. ° 

During  Ci  1983  only  tortality  rates  for  healtla  care  providers 
performing  selected  surgical  procedures  were  reported  in  accordance  with  the 
DoD  directive."^  recently  received  correspondence  from  Headquarters, 
Department  of  the  Army,  inplements  an  interim  basis  morbidity  review,  Phase 
II  of  the  DoD  Standards  for  Health  Care  Provider  Performance  (Appendix  A). 
The  first  report  of  marbidity  data  will  be  required  for  the  last  quarter  of 
CY  84.  The  rrorbidity  review  incorporates  an  assessment  technique  known  as 
"occurrence  screening"  to  identify  medical  or  surgical  outcomes  complicated 
by  untoward  events  or  occurrences.  Eighteen  separate  occurrence  screening 
criteria,  categorized  by  elements,  exceptions  and  instructions/definitions 
have  been  published  as  an  enclosure  to  the  basic  correspondence  from 
Headquarters,  Department  of’  the  Army.  Attending  physicians  are  required  to 
complete  "occurrence  found"  when  applicable  for  each  patient  upon  discharge, 
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at  the  death  of  a  patient,  or  at  the  earliest  time  after  an  occurrence  is 
identified.  A  random  audit  of  10  oercent  of  the  records  of  patients 
discharqed  will  be  performed  monthly  by  designated  personnel  to  insure  the 
accuracy  and  timeliness  of  the  provider  screens.  Results  will  provide  a 
data  base  for  aoprooriate  quality  assurance/risk  nanagement  actions.  Two 
annual  morbidity  reports  noting  occurrences  by  specialty  per  1000  discharges, 
and  occurrences  per  1000  patient  discharges  will  be  forwarded  annually 
throunh  the  ira^jor  command  to  fleadauarters ,  Etepartment  of  the  Army. 

Many  ohvsicians  have  become  skeptical  of  performance  evaluations 
integrated  into  the  ouality  assurance  process  because  of  poorly  designed 
criteria.  Unfortunately,  Standards  for  DoD  Health  Care  Provider  Performance 
may  be  justifiablv  criticized.  The  standard  mortality  rate  by  procedure  ’^s 
established  for  CY  1933  from  a  review  of  surgical  results  for  1982  at  fifteen 
DoD  i^TTFs.  The  thrasnold  for  mandatory  review  by  the  hospital  commander  was 
established  as  one  standard  deviation  from  a  procedural  rrean  mortality 
rate.^  This  method  of  assessment  fails  to  account  for  individual  case 
differences  which  impact  on  the  success  or  failure  of  provider  intervention. 
This  shortcoming  allows  the  provider  '.vho  is  identified  for  exceeding  a 
procedural  threshold  mortality  rate  to  argue  that  high  risk  patients  rather 
than  provider  shortcomings  vere  the  source  of  the  high  nortality  rate.  As 
noted  earlier,  the  lawyers  representing  Colonel  Stanford  and  tine  United 
States  Air  Force  attempted  to  use  patient  health  prior  to  surgery  as  a  factor 
mitigating  against  successful  surgical  <xitcomes.  In  fact,  the  mandatory 
review  by  the  hospital  oommander  is  required  to  allow  such  determinations  to 
be  made.  Regardless  of  the  results  of  the  hospital  commander's  review; 
however,  the  result  becomes  a  permanent  part  of  the  provider's  credentials 
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file.  Presently,  cxemolication  norms  for  selected  procedures  have  not  been 
established  as  forecast  by  previous  directives.  Any  attemot  to  set  mrbiditv 
standards  without  incorporating  the  concept  of  case  severit/  will  suffer 
similar  criticism. 

feverit'.'  of  illness  i.idexes  use  clinical  data  to  olace  patients  into 
distinct  caceaoriss  of  interest.  Recent  applications  have  involved 
classification  of  tatients  into  distinct  clinical  and  financial  categories  to 
facilitate  nore  cost-effective  case-m.ix  rmnaaement.  Ihe  indexes  are  touted 
as  an  ixorovement  over  diaqnosis  related  groups  (DRGs)  because  of  the 
incorporation  of  ciinicallv  meaningful  data  wich  improves  communication  mth 
nhysicians.  because  sever i tv  of  illness  indexes  are  adjusted  for  severitv, 
chvsicians  .^v  not  justify  disorocortionate  resource  use  based  uron  the 
ccsition  unat  their  patients  are  iiore  severely  ill.  Use  of  severity  of 
illness  indexes  encourages  the  comcarison  of  length  of  stay  and  other 
measures  of  resource  iconsamption  among  nembers  of  the  physician  staff.  Thus, 
the  major  indexes  have  the  potential  to  measure  physician  performance 
regarding  resource  use  .and  to  act  as  a  catalyst  for  chanqing  inefficient 
provider  behavior.^  3y  extension,  the  author  contends  that  severeness  of 
illness  scales  may  be  used  to  assess  the  outcome  of  patient  care  by  enablinq 
comparison  of  mortality  and  morbiditv  rates  adjusted  for  case  severity. 

Statement  of  the  Problem  h 

The  problem  is  to  determine  if  case  severity  is  significantly 
related  to  sui jical  mortality  and  morbiditv  outcomes. 
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Objectives 

The  objectives  of  this  research  were  to: 

1.  Review  the  CYs  1983  and  1984  reports  of  nortality  rates  by  Landstuhl  Army 
Regional  Medical  Center  (LARMC). 

2.  Identify  appropriate  severity  of  illness  indexes  to  aooly  to  martality 

review  target  cases. 

3.  Incorporate  the  selected  indexes  into  the  quantitative  analysis  of 

surgical  nartalities  and  marbidities. 

4.  Determine  the  association  between  the  selected  severity  of  illness 

indexes,  and  martality  and  norbidity  outcomes. 

Criteria 

A  level  of  =  .05  was  used  to  determine  the  association  between 
case  severity  and  surgical  outcomes. 

Assunption  / 

For  the  purposes  of  this  study,  it  was  assumed  that  the  historical 
data  base  provided  by  LAFMC  records  will  be  representative  of  current 

hospital  activities. 


Limitations 

Known  limitations  are  that: 

1.  The  study  was  be  limited  to  surgical  cases  at  LARMC.  Standards  for 
Health  Care  Provider  Performance,  the  initial  attempt  to  assess  provider 
performance  against  threshold  martalities,  were  limited  to  selected 
surgical  cases.  An  examiriation  of  the  same  set  of  surgical  procedures 
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provided  a  convenient  subset  of  all  therapeutic  interventions  at  LA8MC. 
The  definitive  nature  of  surgery  facilitated  easyy determination  of  case 
severity  before  inter\’’ention  and  mortality /morbidity  outcomes  ^^ich 
followed. 

2.  The  data  obtained  from  medical  records  has  been  subjected  to 
retrospective  analysis.  This  vqs  a  limitation  because  the  determination 
of  case  severity  and  surgical  outcomes  depended  upon  the  accuracy  of 
information  contained  in  the  medical  records.  Concurrent  analysis  would 
have  permitted  real-time  education  of  health  care  providers  and  records 
administrators  regarding  mortality  and  morbidity  complications  of 
interest  thereby  enhancing  the  accuracy  of  records  entries. 

3.  The  research  was  limited  to  CYs  1983  and  1984.  The  determination  of 
surgical  outcomes  resulted  from  a  systematic  review  of  narrative 
summaries  and  inpatient  medical  records.  Inpatient  records  prior  to  CY 
1983  have  been  retired  and  v^re  thus  not  available  for  review. 

Study  Methodology 

A  review  of  the  LARMC  response  to  DoD  directive  6025.1  reveals  that 
one  provider  exceeded  the  procedural  mortality  threshold  during  the  period  of 
1  August  1983  until  1  January  1984.  No  corrective  action  was  considered 
necessary  by  the  commander  because  the  provider  was  not  deemed  to  be  at 
fault. The  annual  review  conducted  for  CY  1984  revealed  that  no 
surgeon  exceeded  established  mortality  norms.  No  credentials  actions  were 
taken  in  those  cases  where  mortalities  occurred.  A  hospital-wide  summary  of 
mortality  data  revealed  that  mortality  rates  for  each  of  the  selected 
procedures  were  wdthin  established  norms. The  sparcity  of  information 
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contained  in  each  reponse  failed  to  reveal  whether  nortality  cases  were 
reviewed  to  determine  which  factors  contributed  to  patient  mortalities. 
Specific  criteria  for  examining  provider  performance,  aside  from  the 
procedural  mean  mortalities  for  the  selected  surgical  procedures,  also  were 
not  discussed.  This  informational  void  provided  the  historical  background 
from  \vhich  a  systemtic  examination  of  surgical  outcomes  was  conducted. 

A  review  of  inpatient  records  was  necessary  to  retrieve  the 
information  regarding  case  severity,  and  whether  mortalities  or  complications 
had  occurred  during  the  designated  surgical  procedures.  Exclusive  reliance 
on  manual  selection  of  the  inpatient  records  would  have  proven  difficult  and 
time  consuming.  Appendix  B  contains  correspondence  directed  to  the  Special 
Studies  Branch,  Patient  Administration  Systems  and  Biostatistics  Activity 
(PASBA).  A  special  retrieval  of  information  from  the  Individual  Patient 
Data  System  (EPOS)  was  requested  to  provide  information  regarding  the  study 
variables.  Results  of  the  special  study  were  used  to  retrieve  iipatient 
medical  records  for  further  analysis.  This  selection  of  records  contained 
the  set  of  surgical  cases  deemed  ocsnplicated  when  judged  against  recently 
published  occurrence  screening  criteria.  Records  from  each  sample  were 
classified  according  to  surgery  type,  case  severity,  presence  of 
corplications  and  whether  the  patient  died.  A  separate  random  sample 
selected  approximately  five  percent  of  the  surgical  case  records  excluded  by 
the  IPDS  retrieval.  This  random  sample  represented  the  surgical  cases 
without  complications. 

Two  methodologies  were  employed  for  assessing  patient  severity  of 
illness.  Staging  is  one  method  for  segregating  patients  by  case  severity. 
The  method  calls  for  the  classification  of  a  medical  problem  or  a  disease 
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into  discrete  stages. Variations  o£  this  concept  exist  and  selection 
of  an  appropriate  methodology  facilitated  comparison  of  states  of  wellness 
betv«en  patients.  Disease  stages  vere  determined  by  use  of  disease  staging 
criteria  sets  developed  by  SysteMetrics,  Inc.,  Santa  Barbara,  California.  In 
the  staging  methodology  adopted,  diseases  are  divided  into  four  major 
categories: 


STAGE  I:  Conditions  with  no  complications  or  problems  of 
minimal  severity. 

STAGE  II:  Problems  limited  to  an  organ  or  system; 

significantly  increased  risk  of  complications. 

STAGE  III:  Multiple  site  involvement;  generalized  systemic 
involvement;  poor  prognosis. 

STAGE  r/:  Death. 

A  f»nel  of  23  medical  consultants  was  formed  to  transpose  specific  diagnoses 
onto  the  staging  fraiTework  described  above  on  the  basis  of  clinical  findings 
and  standard  diagnostic  namenclature.  These  "medical  staging  criteria"  were 
then  translated  into  "coded  criteria"  by  assigning  diagnostic  codes  to 
describe  each  stage.  All  diseases  were  not  included  in  the  staging 
algorithm.  The  project  focused  on  major  diseases  of  each  etiology-body 
system  class  which  characterized  the  admissions  of  typical,  short-term 
hospitals  in  the  United  States.  Each  disease  of  the  target  group  was 
assigned  to  two  members  of  the  panel  to  be  staged  independently.  Each 
condition  was  divided  into  at  least  the  four  basic  staging  categories,  and 
the  development  of  subcategories  vras  encouraged  as  seemed  appropriate.  The 
results  of  the  independent  staging  efforts  of  the  two  physicians  were 
reviewed  by  a  third  physician.  Joint  discussions  ensued  to  reach  a  consensus 
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of  opinion.  An  example  of  the  medical  criteria  set  developed  for  Diabetes 
Mellitus  is  included  in  Appendix  C. 

The  medical  criteria  sets  were  then  translated  into  coded  criteria 
sets  using  the  three  irost  recent  international  diagnostic  classification 
systems:  ICDA-8,  H-ICDA-2  and  ICD-9-CM.  Each  statement  in  the  medical 

criteria  sets  ras  represented  by  the  codes  or  combinations  of  codes 
reflective  of  the  conditions  described.  The  use  of  combinations  of  codes 
permits  the  consideration  of  the  entire  set  of  diagnostic  data  contained  in 
the  discharge  summary,  rather  than  the  principle  diagnosis  only.  Appendix  D 
provides  the  coded  staging  criteria  set  for  Diabetes  Mellitus. 

A  simpler  measure  of  case  severity  is  the  "body  systems  affected" 
approach.  The  logic  underlying  this  approach  is  sinple.  The  number  of  body 
systems  affected  is  an  indication  of  the  severity  of  the  disease.  One  easy 
method  of  calculation  is  to  treat  each  Major  Diagnostic  Category  as  a  body 
system.  The  Commission  on  Professional  and  Hospital  Activities  (CPHA) 
enployed  the  body  systems  approach  to  analyze  length  of  stay,  margin  under 
prospective  payment  by  diagnosis  related  group  (DRG)  and  number  of  body 
systems  affected. Conversation  with  Stanley  Mendenhall,  Case  Mix 
Development  Manager,  CPHA  and  a  presenter  at  the  1985  American  Cbllege  of 
Hospital  Administrators  Congress  on  Administration  convinced  the  author  to 
include  this  index  of  case  severity. 

The  contingency  table  depicted  in  Table  1  provides  the  basic  model 
for  analysis.  The  two  criteria  of  classification  will  be  case  severity  amd 
surgical  outcome.  Case  severity  refers  to  tlie  assessment  of  patient  health 
as  determined  from  the  selected  severity  of  illness  index  prior  to  surgical 
intervention.  Surgical  outcome  refers  to  the  presence  or  absence  of 
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mortalities  or  other  selected  complications  resultinq  from  surgery.  Surgical 
mortalities  vere  the  initial  focus  of  the  published  standards  for  DoD  Health 
Care  Provider  Performance.  Canplications  have  beccane  an  additional  item  of 
concern  with  the  publication  of  interim  guidance  from  DoD  and  have  been 
included  to  assess  morbidity  in  this  study.  Chi  square  tests  of  homogeneity  ^ 
and  independence  will  be  employed  to  determine  the  relationship  between  case 
severity  and  surgical  outcome. 


TABLE  1 

MODEL  FOR  ANALYSIS 


CY  1983-1984  Surgical  Cases 


1  'S 
!  8 

1 

Criterion  of 

Classification 

First  criterion 
of  classification 

1 

2 

3 

C 

Total 

1 

Nil 

Ni2 

Ni3... 

Nc 

Ni 

2 

N21 

N22 

N23--- 

N2c 

N2 

3 

• 

N3I 

N32 

N33--- 

N3c 

• 

N3 

• 

« 

r 

Nri 

Nr2 

Nr3’ • • 

Nrc 

Nr 

Total 

Ni 

N2 

N3  . . . 

Nc 

N 

Source:  Wayne  W. 

/ 

Daniel, 

Applied  Nonparametric  Statistics 

(Boston:  Houghton 

Coitpany) :  p.  163. 


II .  DISCUSSION 


Sampling  Results 

Results  of  the  requested  records  screen  from  PASBA  indicated  that 
LARMC  had  1592  records  containing  the  specified  surgical  codes  for  CY  1983. 
Comparative  figures  for  Frankfurt  Anny  Medical  Center  and  the  eight  stateside 
Army  medical  centers  totalled  20,938  records. A  second  screen  of  LABMC 
records  was  reauested  for  surgical  cases  occurring  during  CY  1984.  One 
thousand  three  hundred  eighty-seven  records  were  selected.  This  total 
reflects  only  those  records  coded  during  CY  1984.^^  retailed  selection 
criteria  and  results  are  provided  by  Table  2.  Selection  criteria  employed  by 
PASBA  did  not  always  closely  approximate  occurrence  screening  criteria 
published  by  DoD.  Items  5,  7,  9,  12,  and  17  captured  a  broader  range  of 
records  than  were  prescribed  by  occurrence  screening  criteria.  Items  4,  13 
and  15  reflect  categories  from  which  records  could  not  be  selected.  Finally, 
one  screening  category,  number  10,  did  not  apply  to  surgical  cases. 

In  spite  of  these  screening  deficiencies,  information  provided  by 
PASBA  regarding  the  selected  LAFMC  records  facilitated  nore  accurate 
determination  of  those  surgical  cases  with  mortalities  and  other 
complications.  Appendix  E  provides  an  extract  of  those  surgical  cases 
resulting  in  patient  mortalities  during  CY  1983.  Data  provided  by  the 
extracts  allowed  for  some  records  to  be  excluded  from  further  consideration. 
For  those  records  not  excluded,  a  thorough  review  of  available  narrative 
summaries  or  complete  inpatient  records  was  undertaken  to  determine  the 
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TABLE  2 

OCCURRENCE  SCREEN  APPRDXIMATIOSI 


Screening 

Criteria^ 

Disposition  ICD-9 

LARMC 

1983 

Group 

LAFMC 

1984 

Group 

#1 

Unable  to  make  selection 

#2 

555 

12,543 

24 

718 

#3 

9952,9998 

0 

32 

0 

29 

#4 

Unable  to  make  selection. 

#5 

S,T,U 

37 

446 

34 

349 

#6 

9971 ,9973 

0 

332 

0 

261 

#7 

9970,9971 

9973,9975 

0 

360 

0 

339 

#8 

Q,V,W 

7 

366 

7 

353 

#9 

9970 

0 

10 

0 

24 

#10 

Not  required. 

#11 

664,665, 

9982 

36 

292 

26 

329 

#12 

546 

11,315 

570 

11,447 

#13 

Unable  to  make  selection. 

#14 

996-999 

18 

1345 

19 

1334 

#15 

Selected  as  #6. 

#16 

9987 

0 

0 

0 

1 

#17 

12 

1179 

32 

1133 

#18 

P 

0 

19 

0 

17 

^Numbers  cited  correspond  to  occurrence  screening  criteria  listed  in 
Appendix  A. 
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presence  of  mortalities  or  complications  following  surgery. 

Results  obtained  from  the  two-fold  PASBA  screen  and  manual  selection 
process  represent  a  sample  of  surgical  cases  with  complicated  outcomes. 
Results  are  presented  for  CYs  83  and  84  in  Appendix  F  and  Appendix  G 
respectively.  Categories  of  information  provided  include  the  last  four 
numbers  of  each  patient's  social  security  number,  register  number,  procedure 
and  occurrence  found.  A  manual  screen  of  187  narrative  summaries  and/or 
inpatient  records  resulted  in  the  identification  of  49  surgical  cases  with 
complications.  Thirteen  of  the  complicated  cases  were  mortalities.  Severity 
of  index  scores  provided  by  the  Disease  Staging  and  Body  Systems 
methodologies  are  listed  for  each  record,  although  discussion  of  the 
procedures  used  to  obtain  these  results  will  be  deferred  until  later  in  the 
text. 

A  five  percent  selection  of  records  was  also  used  to  obtain  a 
pertinent  sample  of  uncomplicated  cases.  An  index  of  operations  performed 
during  CYs  83  and  84  and  available  on  microfiche  from  PASBA  aided  the 
selection  process.  Records  which  could  not  be  located  were  eliminated  from 
the  sample  without  replacement.  Cases  which  evidenced  complications  during  a 
manual  review  of  records  and/or  narrative  summaries  were  also  excluded.  A 
total  of  149  surgical  cases  were  reviewed^^total^nd  115  were  determined  to  be 
free  of  conplications.  Again,  severity  indexes  were  applied  to  each  record 
and  scores  assigned  following  evaluation  using  the  Disease  Staging  and  Body 
Systems  nethodologies.  Appendix  H  and  Appendix  I  catalog  results  for  CYs 
1983  and  1984  successively. 
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Severity  of  Illness  Indexes 

Application  of  the  two  chosen  severity  of  illness  indexes,  Disease 
Staqinq  and  Body  Systems,  proved  to  be  the  most  arduous  task  faced  in 
collectinq  data  and  conductinq  analyses.  As  the  association  between  patient 
health  prior  to  surqery  and  surqical  outcome  as  measured  by  the  presence  or 
absence  of  nortalities  and  complications  are  the  variables  of  interest,  qreat 
care  had  to  be  taken  to  code  the  state  of  health  presented  prior  to  surqery. 

Assiqnment  of  disease  staqes  to  each  of  the  surqical  cases  proved  to 
be  a  difficult,  time  oonsuminq  process.  Staqinq  software  has  been  developed 
to  implement  the  Disease  Staqinq  methodoloqy.  The  software  packaqe  is 
desiqned  to  assiqn  a  staqe  of  illness  from  standard  hospital  discharge 

abstract  data.  All  diagnostic  codes  contained  in  the  record,  gender  and 

discharge  status,  plus  specific  procedure  codes  are  examined  in  two  distinct 
phases.  First,  a  patient  record  is  staged  for  every  disease  category 
indicated  by  the  dignostic  codes  in  the  discharge  abstract  data.  Second, 
software  flags  are  posted  bo  determine  vhether  the  principal  diagnosis  v^as 
used  bo  stage  the  secondary  diagnoses.  The  patient  is  staged  in  the  disease 
category  with  the  highest  numerical  score  related  to  the  principal 

diagnosis. Unfortunately,  neither  the  software  package  nor  automation 

suf^rt  were  available  to  permit  computer  assisted  staging  of  the  surgical 
cases  identified  in  this  study.  Microfiche  copies  of  ICD-9-CM  coded  criteria 
for  Disease  Staging  were  purchased  from  the  National  Technical  Information 
Service  and  used  to  manually  approximate  the  algorithm  employed  by  the 
staging  software.  For  each  surgical  case  identified  in  the  samples  of 
conplicated  and  uncomplicated  cases,  principal  and  related  diagnoses  were 
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identified  and  staged  by  narrative  description  and  ICD-9-CM  code  contained  in 
the  inpatient  record.  The  highest  stage  identified  by  this  process  vas  then 
recorded  as  an  index  of  case  severity  prior  to  surgery.  Several  difficulties 
were  encountered  in  oiploying  this  nethodology.  The  coding  accotiplished  by 
Inpatient  rtecords  Branch  at  lAPMC  appeared  to  be  consistent  and  of  generally 
high  quality.  Narrative  descriptions  of  the  disease  or  condition  of  the 
patient  varied  considerably.  Although  this  is  not  unexpected,  use  of  a 
medical  dictionary  was  necessary  to  identify  where  synonyms  were  anployed. 
Application  of  the  staging  algorithm  required  practice  and  several  attempts 
per  case  during  the  initial  staging  process.  As  experience  was  gained, 
staging  proceeded  more  quickly  and  results  could  be  expressed  nore 
confidently.  The  staging  scores  presented  in  ^^pendices  F  through  I 
represent  a  correct  application  of  the  methodology  and  therefore,  an  accurate 
index  of  case  severity.  Disease  Staging  failed  to  index  every  case 
represented  by  the  two  samples.  Sate  difficulties  were  encountered  in 
staging  trauma  cases.  Three  of  49  con^licated  cases  could  not  be  staged,  and 
12  of  115  of  the  uncomplicated  cases  defied  staging  attempts. 

■  The  Body  Systems  approach  was  much  easier  to  employ.  A  simple  count 
was  taken  of  Major  Diagnostic  Categories  as  reflected  by  the  principal  and 
secondary  diagnoses  listed  in  the  narrative  summary  for  each  case.  Oily  one 
case  with  complicated  outcomes,  a  premature  birth  v*iich  resulted  in  death, 
could  not  be  coded  effectively.  One  fallacy  was  detected.  The  Body  Systems 
methodology  failed  bo  quantify  the  extent  of  injury  or  disease  when  just  one 
body  system  was  affected.  Requirements  for  support  services,  an  indication 
of  case  severity,  were  sometimes  not  reflected  by  conditions  covered  by  the 
primary  and  secondary  diagnoses.  Body  Systems  results  listed  in  Appendices  F 
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through  I  provide  the  second  indication  of  case  severity  for  the  samples  of 
conplicated  and  uncomplicated  surgical  case  results. 

Chi  Square  Tests  of  Homogeneity 

The  chi  scyare  test  of  homogeneity  is  used  to  determine  whether  two 
populations  are  homogeneous  regarding  the  proportion  of  nembers  possessing 
the  variable  of  interest.  The  null  hypothesis,  Hq,  states  that  the 
populations  of  interest  are  homogeneous.  The  alternative,  H-| ,  states  that 
the  populations  of  interest  are  heterogeneous. The  two  populations  to 
be  examined  are  represented  by  the  samples  of  complicated  and  uncomplicated 
surgical  cases.  The  variable  of  interest  is  case  severity  as  reflected 
separately  by  the  two  severity  of  illness  indexes.  Subsets  of  the  sample  of 
conplicated  cases  have  been  analyzed  for  specific  complications  of  interest; 
mortalities,  postoperative  complications  and  intraoperative  damage  to  body 
parts  or  organs  during  surgery.  Results  of  the  analyses  are  summarized  in 
Table  3.  Contingency  tables  and  computations  for  each  statistical  analysis 
have  been  placed  in  the  ^pendices  noted. 

Results  of  the  chi  square  test  of  homogeneity  comparing  complicated 
and  uncomplicated  surgical  cases  reveal  that  the  two  populations  are 
heterogeneous  regarding  case  severity  as  measured  by  both  the  Disease  Staging 
and  Body  Systems  methodologies.  An  examination  of  the  contingency  table 
charting  observed  cell  frequencies  reveals  a  nuch  higher  preportion  of  cases 
assigned  to  Stage  3  for  complicated  cases,  12  of  46,  compared  to 
uncomplicated  cases,  one  of  103.  Similarly,  three  or  more  body  systems  are 
involved  in  nine  of  48  complicated  cases  compared  to  1  of  115  uncomplicated 
cases  (Appendix  J). 


CHI  SQUARE  TESTS  OE  HOMOGENEITY 


*Cell  expectency  < 
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Thin  pattern  holds  for  a  comparison  of  a  subset  of  complicated  / 
cases,  those  vhich  result  in  patient  mortalities;  and  all  uncomplicated 
cases.  The  samples  are  heterogeneous  when  both  Disease  Staging  and  Body 
Systems  (Appendix  K)  nethodologies  are  employed  to  index  case  severity. 
Because  of  the  small  number  of  mortalities,  expected  cell  frequencies  are 
small.  One  cell  in  the  contingency  tables  reflecting  each  severity  of 

illness  index  is  fractional  and  this  condition  violates  guidance  usually 
tendered  regarding  minimum  cell  frequencies. However,  at  least  one 


author  suggests 

that  use 

of  chi  square  tests 

remains 

appropriate 

with 

expectations  in 

excess  of 

.5,  a  constraint  met 

by  the 

results  of 

this 

study. 20 

Different  results  are  achieved  V'hen  other  subsets  of  complicated 
cases  are  compared  with  uncomplicated  cases.  Cases  with  postoperative 
complications  were  homogeneous  with  uncomplicated  cases  regarding  both 
indexes  of  case  severity  (Appendix  L).  Cases  with  intraoperative  damage  to 
body  parts  or  organs  v>ere  homogeneous  with  uncomplicated  cases  regarding 
Disease  Staging,  and  heterogeneous  when  the  Body  Systems  index  was  used 
(Appendix  M) . 

Consideration  of  the  results  of  these  analyses  leads  one  bo  believe 
that  case  severity  ray  indeed  be  related  to  surgical  outcome  when  considering 
complications  in  total,  or  the  subset  of  complications  represented  by 
mortalities.  Conclusions  regarding  the  relationship  between  intraoperative 
damage  and  case  severity  as  measured  by  the  Body  Systems  index  seems  less 
certain  because  the  expected  values  are  so  small  and  the  threshold  for 
significance  is  barely  met.  A  chi  square  test  of  independence  has  been 
used  to  determine  whether  case  severity  and  surgical  outcome  are  associated. 
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Chi  Square  Test  of  Independence 

The  chi  square  test  of  independence  is  used  to  determine  association 
between  the  two  variables  of  interest.  The  null  nypothesis,  Hg,  states 
that  the  variables  are  independent.  The  alternative  hypothesis,  H-j ,  states 
that  the  variables  are  associated. 21  The  two  variables  examined  by  this 
study  are  case  severity  and  surgical  cases  with  corplicated  outcones.  The 
ideal  situation  vould  have  permitted  sampling  from  the  larger  population  of 
all  surgical  cases  targeted  by  this  study.  Unfortunately,  the  relative 
infrequency  of  all  complications,  and  more  specifically,  mortalities,  forced 
exclusive  consideration  of  c  mplicated  surgical  cases.  Based  upon  the 
results  of  the  chi  square  tests  of  homogeneity,  surgical  outcome  as  defined 
by  mortal ities/nonmortali ties  and  case  severity  as  defined  by  both  the 
Disease  Staging  and  Body  Systems  indexes  vere  tested  to  determine  whether 
they  were  associated.  Specific  categories  of  complications  have  been 
compared  individually  against  the  remainder  of  the  sample  regarding 
distribution  across  the  Disease  Staging  and  Body  Systems  indexes  used  to 
measure  case  severity. 

'table  4  summarizes  the  results  of  each  analysis.  Contingency  tables 
and  statistical  computations  have  been  placed  in  Appendix  N.  Results 
indicated  that  case  severity  as  measured  by  both  Disease  Staging  and  Body 
Systems  indexes,  and  mortalities  following  surgery  are  associated.  Nine  of 
11  case  mortalities  were  indexed  as  Stage  3  as  compared  to  3  of  35 
nonmortalities.  Seven  of  12  mortalities  resulted  from  injuries  or  diseases 
affecting  three  or  more  body  systems.  Only  two  of  36  nonmortalities  involved 
injuries  or  diseases  affecting  three  or  more  body  systems. 
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CHI  93UARE  TESTS  OF  INDEPENDENCE 

Row  Variable  Measurement  Statistical  Decisions  Appendix 
Cells  of  Severity  Result 

Mortality/  Disease  X^=  23.3  Reject  Hq  N 

Nonmortality  Staging 

.  / 

Mortality/  Body  Systems  X'^=  22.7  Reject  Hq  N 

^fonmortalitv 


III.  CONCLUSIONS  A^ro  RECOMMENDATIONS 


Conclusions 

Results  of  the  statistical  analyses  compel  one  to  conclude  that 
populations  of  surgical  cases  with  complicated  outcomes  and  those  vhich  are 
uncomplicated  differ  regarding  the  proportion  of  each  receiving  assignment  to 
differing  levels  of  severity  as  reflected  by  Disease  Staging  and  Body  Systems 
methodologies.  Both  indexes  reflect  a  higher  proportion  of  complicated  cases 
rated  more  severely  orior  to  surgical  intervention  than  cases  which  conclude 
without  complication.  This  trend  continues  when  a  subset  of  complicated 
cases,  surgical  mortalities,  is  compared  with  the  sample  of  uncomplicated 
cases.  Further  analysis  by  chi  square  tests  of  independence  strongly 
supports  the  direct  association  between  case  severity  prior  bo  surgery  and 
surgical  outcome. 

The  incorporation  of  severity  of  illness  indexes  into  provider 
performance  standards  facilitates  accurate  assessment  of  quality  of  care.  A 
measurement  tool  incorporating  a  severity  of  illness  index  would  possess  all 
of  the  aforementioned  necessary  components;  1)  Desired  outcomes  may  be 
defined  as  the  change  in  stages  or  body  systems  affected.  2)  Both  Disease 
Staging  and  Body  Systems  criteria  have  been  formulated  by  professionals.  3) 
Each  severeness  of  illness  indexes  is  scored  numerically  which  permits 
automated  processing.  4)  Finally,  a  recorded  pattern  of  observed  surgical 
outcomes  differentiated  by  severity  of  illness  index  will  improve  prediction 
of  outcome  and  significant  deviations  from  predicted  outcome. 
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Severity  of  illness  indexes  could  also  be  incorporated  into  outcome 
oriented  evaluations  of  OTFs.  Recent  criticism  has  been  leveled  at  the 

conditions  of  the  physical  plants  of  many  DoD  hospitals.  Brooke  Army  Medical 
Center  and  overseas  facilities  in  general  have  been  condemned  as 
inadequate. Type  of  hospital  and  facility  size  have  also  proven  to  be 
crucial  determinants  in  the  quality  of  physician  performance. 23 
comparison  of  facility  performance  regarding  surgical  mortalities  would  be 
enhanced  by  using  severity  of  illness  indexes  to  exclude  case  severity 
biases. 

A  comparison  of  Disease  Staging  and  Body  Systems  involves  several 
important  considerations.  Both  reflect  the  relationship  between  case 
severity  and  surgical  outoone.  Disease  Staging  fails  to  classify  every 
disease  or  condition  and  seems  to  fall  short  during  mass  trauma  when  several 
major  body  systems  are  involved.  In  contrast,  the  Body  Systems  count  fails 
to  estimate  the  extent  of  injury  when  only  one  body  system  is  involved. 
Disease  Staging  is  more  cumbersome  to  employ  manually  than  the  application  of 
the  Body  Systems  irethodology;  however,  Disease  Staging  has  been  incorporated 
into  a  software  package  which  runs  on  an  IBM  mainframe  computer.  Both 
systems  require  familiarity  with  medical  records  and  are  labor  intensive. 

Recommendations 

As  the  relationship  between  case  severity  and  surgical  outcome  has 
been  established,  ccxnparisons  between  outcomes  afforded  by  individual 
providers  or  MTFs  should  incorporate  an  index  of  disease  severity.  In  the 
absence  of  fully  automated  indexing  systems,  manual  employment  of  Disease 
Staging  or  Body  Systems  should  be  continued  retrospectively  on  an  exceptional 
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basis.  The  relatively  few  number  of  complications  recorded  durinq  this  study 
and  the  small  expected  frequencies  obtained  through  computation  make  further 
examination  of  the  severity  of  illness  indexes  imperative. 
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OCCURRENCE  SCREENING 


1.  Occurrence  screening  is  a  Quality  Assurance  (QA)  assessment  technique  to 
identify  specifically  potentially  important  unaccepted  or  untoward  results  of 
medical  or  surgical  treatment  and  to  ensure  timely  staff  review  and  analysis 
of  these  cases.  It  also  serves  to  quickly  identify  such  cases  to  the  facility 

QA  coordinator  and  risk  manager  for  appropriate  management  action  when  indicated. 

2.  The  18  occurrence  screens  on  DA  Form  5365>R  (Occurrence  Screening  Checklist) 
will  be  used.  Additional  screens  may  be  added,  as  desired.  See  Enclosure  1  for 
exceptions,  instructions,  and  definitions.  Attending  practitioners,  or  designated 
persons,  complete  "occurrence  found"  for  each  patient  at  discharge,  at  the  death 
of  the  patient,  or  at  the  earliest  time  after  an  occurrence  is  identified.  (Any 
additional  variations  noted  for  chat  patient  during  a  single  hospitalization 
should  be  added  to  the  existing  form.)  The  checklist  will  be  sent  to  the  KTF  QA 
coordinator.  DA  Form  S365-R  will  be  locally  reproduced  on  8^  x  11  inch  paper. 

A  copy  for  local  reproduction  purposes  can  be  found  at  the  back  of  this  letter. 

3.  The  KTF  QA  coordinator  does  the  following; 

a.  Determines  which  department  or  service  chief  or  committee  chairperson 
should  evaluate  the  identified  occurrence.  Following  the  evaluation,  the 
Clinical  Analysis  of  Occurrence  portion  is  completed  and  returned  to  the  QA 
coordinator. 

b.  Coordinates  occurrences  with  the  risk  manager. 

c.  Prepares  DA  Form  5365- 1-R  (Provider  Occurrence  Screening  Suraaary) 
monthly  and  sends  it  to  the  KTF  QA  Connittee  and  Credentials  Connittee  for 
review  and  consideration.  DA  Form  3365-1-R  will  be  locally  reproduced  on 
8^  X  11  inch  paper.  A  copy  for  local  reproduction  purposes  can  be  found  at 
the  back  of  this  letter. 

d.  Presents  appropriate  cases  for  discussion  at  the  QA  cormittee  meetings. 

e.  Prepares  a  quarterly  and  annual  sunrnary  by  clinic  service  groupings. 

The  mission  template  of  the  MTF  will  determine  the  clinic  services  established 
in  that  facility. 

A.  The  MTF  QA  Committee  monitors  compliance  with  the  program  and  continually 
reports  pertinent  information  to  the  Credentials  Committee. 

a.  Validation  of  the  accuracy  of  the  "No"  determinations  in  the  "Occurrence 
Found"  column  of  the  DA  Form  5365-R  is  essential  for  accuracy  and  reliability. 

b.  A  random  audit  of  at  least  lO  percent  of  the  records  of  patients  discharged 
will  be  performed  monthly  by  designated  personnel.  Checklists  noted  to  contain 
inappropriate  responses  (or  where  the  correctness  of  a  determination  is  in  doubt) 
should  be  referred  to  the  QA  Committee  for  review  and  followup  action. 


Ir.c;  1 
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5.  The  occurrence  screening  progrBn  applies  to  all  military  and  civilian 
health  care  practitioners  who,  under-  regulations  of  the  AMEDD,  are  credentlaled 
to  provide  nedical  treatment  in  Army  MTFs  as  well  as  interns,  residents,  and 

f e 1  lows. 

6.  The  occurrence  screening  program  does  not  negate  the  completion  of  OA 
Form  il06  (Report  of  Unusual  Occurrence)  per  paragraph  9-6,  AJ?  40-66. 

7.  Two  annual  reports  (RCS:  DD-HA(A)  1637)  submitted  through  the  WACOM  are 
due  to  HQDA  (DASC-PSQ),  Washington,  DC  20310-2300  by  15  February.  These 
reports,  to  accompany  the  report  of  mortality  rates,  will  consist  of  OA  Form 
5366.R  (Occurrences  by  Specialty  Per  1000  Patient  Discharges)  and  DA  Tom 
5366- 1-R  (Occurrences  Per  1000  Patient  Discharges).  All  specialties  will  be 
aggregated  into  the  four  categories  of  Pediatrics,  OB/CYN,  Surgery,  and 
Medicine.  All  rates  will  be  computed  by  type  of  occurrence.  DA  Forms  5366-R 
and  5366.1-R  will  be  locally  reproduced  on  8^  x  11  inch  paper.  Copies  for 
local  reproduction  purposes  can  be  found  at  the  back  of  this  letter. 
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AEMIA-AG  19  Movember  1984 

SUBJECT:  Request  for  Cccurrence  Screen 


THRU:  Commander 

2d  General  Hospital 
ATTN:  AEMLA-x6 
APO  09180 

TO:  Commander 

US  Army  Patient  Administration  Systems  & 
Biostatistics  Activity  (PASBA) 

ATTN:  Ms.  Joyce  Hutchins 
Ft.  Sam  Houston,  TX  78234 


1.  .As  advised  during  my  phone  call  of  9  November  1984,  I  am  submitting  this 
correspondence  to  request  a  special  retrieval  from  the  IPDS  data  base. 

a.  PASBA  is  currently  producing  "selective  procedure  mortality  data"  in 
response  to  COD  Directive  No.  6025.1.  Recent  correspondence  from  OTSG, 
Subject:  "Occurrence  Screening"  (End  1)  seeks  to  incorporate  18  occurrence 
screens  into  the  assessment  of  quality  assurance  in  military  medical 
treatment  facilities.  Request  that  the  assessment  of  selected  surgical 
procedures  be  extended  to  include  these  occurrence  screens  which  have  been 
designed  to  detect  conpli cat ions  as  well  as  mortalities.  Enclosure  2 
provides  a  proposal  for  retrieval  of  data  from  the  IPDS  data  base. 

b.  Request  that  the  retrieval  of  requested  information  be  conducted  from 
CY  83  data  for 

1)  2d  General  Hospital  and, 

2)  As  a  roll-up  of  2d  General  Hospital  IPDS  record  submissions  and 
those  of  similar  facilities  whose  CY  83  IPDS  submissions  have  been  oonplete 
enough  to  permit  meaningful  oomparison. 

2.  This  special  retrieval  will  serve  a  twofold  purpose: 

a.  2d  General  Hospital  will  be  able  to  determine  the  usefulness  of  the 
IPDS  data  base  in  accomplishing  occurrence  screening. 
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AEMIA-AG  19  Novembt"-  1984 

SUBJECT;  Request  for  Occurrence  Screen 

b.  Information  gained  will  be  used  to  effect  analysis  of  th_-  quality 
assurance  assessment  effort. 

3.  Point  of  contact  for  further  information  is  CPT  Michael  H.  Kennedy. 
Telephone  number  is  AUTOVON  483-1110  (Kaiserslautern,  West  Germany).  Ask  the 
operator  to  provide  a  connection  to  Landstuhl  Military  7190  or  8107. 


2  Enel 


MICHAEL  H.  KENNEDY 
CPT,  MSC 

Administrative  Resident 
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REQUESTED  i^DDIFIED  ASSESSMENT  OF  SELECTED  SURGICAL  PROCEDURES 


1.  Modify  the  selected  mortality  data  gathering  procedures  to  screen  the 
following : 

a.  For  the  selected  surgical  procedures  (no  change),  identify: 

1)  Mortalities  and 

2)  Complications  as  noted  by  the  following  occurrence  screens 
(potential  sources  of  information  in  parentheses). 

a)  Readmission  within  six  months  (DA  Form  2985,  Fields  17  or 

18). 

b)  Drug  or  transfusion  reaction  (ICD-9:995.2  &  999.8). 

c)  Unexnected  transfer  from  general  care  bed  to  special  care 

bed  (?). 

d)  Unanticipated  transfer  to  another  acute  care  facility  (DA 
Form  2985;  Field  15,  Codes  S,  T,  U) . 

e)  Cardiac  or  respiratory  arrest  (ICD-9:997.1  &  997.3). 

f)  Organ  failure  (heart,  kidney,  lung,  brain)  not  present  at 
admission  (ICD-9:997.0,  997,1,  997.3,  997.5). 

g)  Neurosensory  or  functional  deficit  or  intractable  pain  not 
present  on  admission  (?). 

h)  Injury  of  organ/body  part  during  invasive  procedure, 
including  obstetrical  delivery  (ICD-9:998.2,  664,  665). 

i)  Unexpected  return  to  operating  room  (DA  Form  2985,  Fields 

46-53). 

j)  Unplanned  removal  or  repair  of  normal  body  part  during 

surgery  (?). 

k.  Post-operative  complications  (996-999). 

l)  Acute  MI  or  CVA  after  surgery  (same  as  e?). 

m)  Cperation  for  removal  of  foreign  body  left  in  operative 
site  (ICD-9:  998.7). 

n)  Repeat  of  the  same  invasive  procedure  during  the  same 
(DA  Fbrm  2985,  Fields  46-53). 
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o)  Discharged  against  rtedical  advice  (DA  Form  2985;  Field  15, 

Code  P ) . 

As  selected  by  the  proposed  data  retrieval,  the  complications  listed  are 
post-operative  in  nature.  An  attempt  has  been  made  to  list  applicable 
DA  Form  2985  and  ICD-9  Codes,  although  this  effort  should  not  be  considered 
comprehensive  and  requires  further  examination  and  confirmation. 

2.  Suggested  format  for  output: 

PATIENT'S  SSN  AGE  GENDER 


DIAGNOSTIC  CODE 


SURGICAL  PROCEDURE 


MORTALITY 


COMPLICATIOJ 
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SURGICAL  OUTCOMES  WITH  COMPLICATIONS, 

CALENDAR  YEAR 

1983 

Last  4 

Reqister  No. 

Procedure 

Occurrence  Found ^ 

Stage 

Body 

Systems 

0000 

383847 

5011 

#8; 

Death 

3.3 

4 

6002 

388203 

5792 

#14: 

Infection 

1.1 

2 

5904 

382756 

5281 

#14: 

Bleeding 

1.1 

1 

3011 

383433 

5538/5541 

assoc. 

#8: 

Died 

3.2 

2 

9012 

386401 

5011 

#9: 

Paresis 

★ 

1 

3721 

379443 

380329 

5690 

#14: 

Bleeding, 
rtn  menibranes 

2.2 

1 

1124 

389529 

5655 

#11: 

Laceration 

1.0 

2 

1629 

385429 

5511 

#14: 

Infection 

2.1 

1 

2532 

384295 

5413/5441 

assoc. 

#14: 

ARDS 

3.3 

4 

7936 

386144 

5683 

#14: 

Fever 

1.0 

1 

9542 

377536 

5340 

#15: 

Cardiac 

arrest 

3.3 

2 

2443 

386144 

5683 

#11: 

Cut  bladder 

1.0 

1 

2151 

379362 

5340 

#8: 

Death 

3.0 

3 

0858 

385603 

5470 

#14: 

Infection 

1.0 

1 

2559 

388116 

5340/5020 

#6; 

Respiratory 

arrest 

3.3 

6 

6861 

380196 

5863 

#11: 

Cut  bladder 

1.0 

1 

3562 

383341 

5541/5340 

#8: 

Death 

3.3 

6 

7967 

388298 

5020/5011 

assoc. 

#8: 

Death 

1.2 

4 

0169 

381122 

1475/5690 

assoc. 

#14: 

Bleeding 

1.2 

1 

6373 

380717 

5690 

#14: 

Bleeding 

2.0 

1 

58 


3979 

383099 

5454/5541 

assoc. 

5986 

384588 

5741 

9390 

386993 

5511 

3192 

381900 

5340 

8595 

377838 

5690 

2496 

387499 

5653 

5198 

380942 

5578 

*Unable  to  index. 


#14: 

Infection 

2.0 

1 

#11: 

Bladder 

perforation 

0.0 

1 

#14: 

Post/op  inf. 

2.4 

2 

#8: 

Death 

3.2 

2 

#14: 

Bleeding 

0.0 

1 

#14: 

Fever 

1.0 

1 

#11: 

Bladder 

perforation 

1.0 

2 

h'Jumbers  cited  corespond  to  occurrence  screening  criteria  listed 
Appendix  A. 
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SURGICAL  OUTCa^ES  WITH  COMPLICATIONS,  CALENDAR  YEAR  1984 


Last  4 

Reqister  No. 

Procedure 

Occurrence  Found ^ 

Stage 

Body 

System 

0900 

401249 

5324/5340 

assoc. 

#14: 

Pneumc  thorax 

2.0 

1 

4204 

394287 

5340 

#8: 

Death 

* 

* 

7208 

391341 

5741 

#14: 

Fever 

2.0 

1 

3310 

393958 

5011 

#8: 

Death 

3.2 

5 

9120 

391292 

5792 

#12: 

Return  to  OR 

2.3 

1 

8321 

396511 

5541 

#8: 

Death 

3.2 

2 

0139 

401706 

5541 

#8: 

Death 

* 

3 

0741 

394044 

5011 

#8: 

Death 

3.2 

1 

2642 

392474 

5683 

#11: 

Bladder 

puncture 

2.0 

1 

3652 

400881 

5683 

#14: 

Hemorrhage 

1.0 

1 

1454 

392602 

5741 

#14: 

Infection 

2.0 

1 

9463 

391747 

5601 

#14: 

Bleeding 

1.0 

1 

4968 

391164 

5470 

#14: 

Dysuria 

1.0 

1 

1070 

396096 

5541 

#8: 

Death 

2.0 

4 

5272 

399638 

400878 

5664 

#2: 

Return  w/i 

6  roos. 

0.0 

1 

3380 

393369 

5573 

#14: 

Headaches 

1.1 

1 

0382 

401578 

5683 

#11: 

Bladder 

puncture 

1.0 

1 

6984 

390816 

5011 

#8: 

Death 

3.3 

2 

61 


3990 

393964 

396757 

397804 

397964 

5014/5011/ 

5890 

#2: 

Return  w/i 

6  mos. 

2.0 

1 

6294 

401207 

5683 

#14: 

Cellulitus 

1.0 

1 

1695 

392264 

5741 

#14: 

Bleeding 

2.0 

1 

7498 

394931 

5741 

#14: 

Post/op 

2.0 

1 

pulmonary 
embolism 
&  wound 


hematoma  & 
infection 

*Unable  to  index. 

^Numbers  cited  correspond  to  occurrence  screening  criteria  listed  in 
Appendix  A, 


APPENDIX  H 

SURGICAL  CASES  WITH  UNCOMPLICATED  OUTCOMES 
CALENDAR  YEAR  1983 
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SURGICAL  OUTCOMES  WITHOUT  OOMPLICATICWS,  CALENDAR  YEAR  1983 


Body 


Last  4 

Register  No. 

Procedure 

Occurrence  Found 

Stage 

Systems 

4900 

380108 

5282 

No 

1.0 

1 

7801 

389378 

5741 

No 

2.0 

1 

6002 

381998 

5741 

No 

0.0 

1 

2802 

379291 

5749 

No 

2.0 

1 

2503 

384903 

5690 

No 

1.3 

1 

4909 

384486 

5741 

No 

* 

1 

0011 

378332 

5664 

No 

0.0 

1 

4215 

380558 

5011 

No 

★ 

1 

7017 

378106 

5664 

No 

0.0 

1 

8617 

378702 

5690 

No 

1.3 

1 

1018 

387433 

5741 

No 

2.0 

1 

0323 

382602 

5741 

to 

1.3 

1 

8324 

379624 

5470 

No 

1.0 

1 

8125 

381883 

5664 

No 

1.1 

1 

7227 

380377 

5741 

No 

1.3 

1 

1228 

389073 

5530 

No 

1.2 

1 

4929 

378698 

5511 

No 

2.4 

4 

5029 

383712 

5684 

No 

2.1 

2 

0232 

385281 

5792 

No 

* 

1 

0733 

388919 

5690 

No 

1.3 

1 

3135 

390134 

5741 

No 

1.3 

1 

9136 

380757 

5664 

to 

0.0 

1 

1338 

383327 

5061 

No 

* 

1 

64 


6738 

388339 

5530 

No 

1.1 

1 

3741 

383612 

5804 

No 

1.0 

1 

5841 

388421 

5741 

No 

2.0 

1 

6742 

380101 

5664 

No 

0.0 

1 

1543 

377160 

5282 

No 

1.0 

1 

6843 

389515 

5690 

No 

1.3 

1 

1244 

388321 

5690 

No 

1.3 

1 

4545 

381300 

5340 

No 

3.1 

1 

2652 

380197 

5690 

No 

^o 

1 

0253 

379253 

5792 

No 

1.1 

1 

9853 

382608 

5741 

No 

2.0 

1 

6354 

379926 

5683 

No 

* 

1 

9155 

385535 

5530 

No 

1.2 

1 

9955 

378701 

5664 

No 

0.0 

1 

4359 

378989 

5470 

No 

2.2 

1 

1860 

380619 

5814 

No 

* 

1 

5662 

379396 

5741 

No 

2.0 

2 

7063 

379332 

5601 

No 

1.0 

1 

8063 

377555 

5381 

No 

1.2 

1 

9863 

378098 

5690 

No 

1.3 

1 

3667 

383641 

5792 

No 

2.4 

2 

0569 

381481 

5530 

No 

1.0 

1 

7170 

386384 

5664 

No 

0.0 

I 

0972 

386833 

5741 

No 

1.3 

1 

7973 

383592 

5511 

No 

2.1 

2 

0274 

382906 

5803 

No 

2.2 

1 

65 


9575 

386066 

5281 

No 

1.0 

1 

3476 

379926 

5683 

No 

* 

1 

7478 

384142 

5741 

No 

1.3 

1 

8879 

379380 

5664 

No 

0.0 

1 

3383 

387891 

5740 

No 

1.0 

1 

7083 

378958 

5792 

No 

1,1 

1 

4384 

386560 

5791 

No 

2.4 

1 

1885 

384156 

5741 

No 

1.3 

1 

1288 

333909 

5690 

No 

1.3 

1 

4689 

384399 

5683 

No 

1.0 

1 

3194 

387731 

5530 

No 

1.2 

1 

4094 

336830 

5530 

No 

1.2 

1 

9895 

337956 

5690 

No 

1.0 

1 

2896 

378101 

5664 

No 

0.0 

1 

2896 

379268 

5684 

No 

1.2 

1 

*Unable 

to  index. 

^Numbers 

cited  correspond 

to  occurrence 

screening  criteria 

listed  in 

/^3pendix  A. 
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SURGICAL  OUTCOMES  WITHOUT  OCWP LIGATIONS,  CALENDAR  YEAR  1984 


Bcx3y 


Last  4 

Register  No. 

Procedure 

Occurrence  Found 

Stage 

Systems 

2803 

397961 

5281 

No 

1.0 

1 

1304 

399252 

5530 

m 

1.1 

1 

5506 

401497 

5530 

No 

1.1 

1 

2707 

397168 

5741 

No 

2.0 

1 

2409 

399138 

5664 

No 

1.0 

1 

3912 

393114 

5684 

No 

1.0 

1 

3313 

399618 

5791 

No 

2.2 

1 

3613 

401503 

5513 

No 

1.1 

1 

0816 

402474 

5814 

No 

2.2 

1 

6520 

391039 

5741 

No 

2.0 

1 

9120 

401082 

5062 

No 

1.0 

1 

3121 

398339 

5470 

No 

2.1 

1 

5822 

393484 

5664 

No 

0.0 

1 

9824 

399963 

5792 

No 

1.0 

1 

3027 

398525 

5597 

No 

* 

1 

5730 

396333 

5803 

No 

2.1 

1 

9431 

396498 

5511 

No 

2.1 

1 

3932 

397449 

5684 

No 

0.0 

1 

4932 

393449 

5664 

No 

0.0 

1 

0536 

397462 

5470 

No 

2.1 

1 

9537 

398038 

5741 

No 

★ 

1 

2439 

392964 

5690 

No 

1.2 

1 

4941 

398878 

5683 

No 

1.0 

2 

68 


0442 

401246 

5653 

No 

1.0 

1 

3843 

399003 

5749 

No 

* 

1 

7744 

398524 

5281 

Ivb 

1.0 

1 

0247 

392584 

5282 

No 

1.0 

1 

3947 

390423 

5381 

Nb 

1.0 

1 

9850 

394327 

5146 

No 

1.1 

1 

9452 

393725 

5690 

No 

* 

1 

4555 

396929 

5814 

No 

1.3 

1 

9456 

399007 

5530 

No 

1.1 

1 

8759 

402265 

5749 

No 

2.0 

1 

9260 

396931 

5803 

No 

2.1 

1 

1161 

394621 

5741 

No 

2.0 

2 

3665 

390876 

5690 

No 

1.2 

1 

9866 

392357 

5664 

No 

0.0 

1 

2269 

393364 

5281 

No 

1.0 

1 

0570 

401440 

5741 

No 

2.0 

1 

9375 

400135 

5530 

No 

1.1 

1 

1377 

391132 

5470 

No 

1.0 

1 

7778 

392088 

5741 

No 

* 

2 

5279 

399638 

5664 

No 

0.0 

1 

7779 

394920 

5792 

No 

1.2 

1 

4787 

395494 

5530 

No 

2.2 

1 

9788 

392634 

5541 

No 

2.0 

1 

0393 

389327 

5684 

No 

1.2 

1 

3594 

396763 

5664 

No 

0.0 

1 

9597 

400179 

5511 

No 

2.1 

1 

69 


1698 

393302 

5814 

No 

2.6 

1 

3998 

395243 

5803 

No 

2.2 

1 

*Unable  to  index. 

^Numbers  cited  correspond  to  occurence  screening  criteria  listed  in 
Aooendix  A. 
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CHI  SQUARE  TESTS  OF  HOMOGENEITY 


Disease  Stage 

Totals 

0.0-1. 9 

2. 0-2. 9 

3. 0-3. 9 

Conplicated  Cases 

20  (28.4) 

14  (13.6) 

12  (4.0) 

46 

Uncomplicated  Cases 

72  (63.6) 

30  (30.4) 

1  (9.0) 

103 

92 

44 

13 

Hq:  Complicated  and  unocgrtplicated  cases 
assignment  to  Disease  Staging  index. 

are  hcmogeneous  regarding 

H-|  :  Complicated  and  uncomplicated  cases 
assignment  to  Disease  Staging  index. 

are  heterogeneous  regarding 

x2  =  26.8  >  X2, 0.995 

=  10.6 

Reject  Hq. 

Body  Systems 

Totals 

1 

2 

3  or  > 

Complicated  Cases 

30  (40.3) 

9  (4.7) 

9  (2.8) 

48 

Uncomplicated  Cases 

107  (96.6) 

7  (11.3) 

1  (7.1) 

115 

137 

16 

10 

163 

Hq  =  Complicated  and  uncortplicated  cases 
assignment  to  Body  Systems  index. 

are  homogeneous  regarding 

H-]  =  Complicated  and  uncomplicated  cases 

are  heterogeneous  regarding 

assignment  to  Body  Systems  index. 
x2  =  28.3  >  ^2^ 0,995  =  10.6 
Reject  Hq. 


APPENDIX  K 

CHI  SQUARE  TESTS  CF  HOMOGENEITY 

COMPARING  SURGICAL  CASES  WITH  MORTALITIES  AND  UNCOMPLICATED  OUTCOMES 
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CHI  SQUARE  TESTS  OF  lOMOGENEITY 


Disease  Stage 

Totals 

0.0-1. 9 

2.0-2. 9 

3. 0-3. 9 

Mortalities 

1  (7.04) 

1  (3.0) 

9  (0.96) 

11 

Uncomplicated  Cases 

72  (66.0) 

30  (28.0) 

1  (9.0) 

103 

73 

31 

10 

114 

Hq:  Case  mortalities  ard  uncomplicated  cases  are  homoqeneous  regarding 
assignment  to  Disease  Staging  index. 

H-| :  Case  mortalities  and  uncomplicated  cases  are  heterogeneous  regarding 
assignment  to  Disease  Staging  index. 

=  81.6  >  X2^0.995  ”  10»6 

Reject  Hq. 


Body  Systems 

Totals 

1 

2 

3  or  > 

Mortalities 

1  (10.2) 

4  (1.0) 

7  (0.8) 

12 

Uncomplicated  Cases 

107  (97.8) 

7  (10.9) 

1  (7.2) 

115 

108  11  8  127 


Hq:  Case  mortalities  and  uncomplicated  cases  are  homogeneous  regarding 
assignment  to  Body  Systems  index. 

H-| ;  Case  mortalities  and  uncomplicated  cases  are  heterogeneous  regarding 
assignment  to  Body  Systems  index. 

x2  =  73.0  >  X2^o.995  = 

Reject  Hq. 


APPENDIX  L 

CHI  SQUARE  TESTS  OF  HOMOGENEITY 
COMPARING  SURGICAL  CASES  WITH  POSTCPERATIVE  COMPLICATIONS 
AND  UNCOMPLICATED  OUTCOMES 
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CHI  SQUARE  TESTS  CF  HOMOGENEITY 


Post/op  Complications 
Uncorrpli Gated  Cases 


Disease  Stage  Totals 

0.0-1. 9  2. 0-3. 9 

12  (15.3)  11  (7.7)  23 

72  (68.7)  31  (34.3)  103 

84  42  126 


Hq:  Cases  with  postoperative  complications  and  unooraplicated  cases  are 
homogeneous  regarding  assignment  to  Disease  Staging  index. 

Hi :  Cases  with  postoperative  complications  and  uncomplicated  cases  are 
heterogeneous  regarding  assignment  to  Disease  Staging  index. 

=  2,6  <  Xi^0^95  =  3,8 

A'jcept  Hq. 


Body  Systems 

Totals 

1 

or  > 

Post/op  Complications 

20 

(21.2) 

3 

(1.8) 

23 

Unoonplicated  Cases 

107 

(105.8) 

8 

(9.2) 

115 

127 

11 

138 

Hq:  Cases  with  postoperative  complications  and  uncomplicated  cases  are 
homogeneous  regarding  assignment  to  Body  Systems  index. 

Hi:  Cases  with  postoperative  complications  and  uncomplicated  cases  are 
heterogeneous  regarding  assignment  to  Body  Systems  index. 

X2  =  1.0  <  Xi,o.95  =  3.8 


Accept  Hq. 


APPENDIX  M 


CHI  SQUARE  TESTS  OF  HOMOGENEITY 


Ca^ARING  SURGICAL  CASES  WITO  lOTRACPERATIVE  DAMAGE 


AND  UNCOMPLICATED  OUTCOMES 
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CHI  SQUARE  TESTS  OF  HOMOGENEITY 


Intra/op  Damaqe 
Uncomplicated  Cases 


Disease  Stage  Ibtals 

0.0-1. 9  2. 0-3. 9 

6  (5.0)  1  (2.0)  7 

72  (73.0)  31  (30.0)  103 

78  32  no 


Hg:  Cases  with  intraooerative  damaqe  and  unconplicated  cases  are 
homogeneous  regarding  assignment  by  Disease  Staging  index. 

H-] ;  Cases  with  intraoperative  damaqe  and  uncomplicated  cases  are 
heterogenous  reoarding  assignment  by  Disease  Staging  index. 

X2  =  0.3  <  Xi^o_95  =  3.8 

Accept  Hg. 

Body  Systems  Totals 

1  2  or  > 

Intra/op  Damage  5  (6.4)  2  (.6)  7 

Uncomplicated  Cases  107  (105.6)  8  (9.4)  115 

112  10  122 


Hg:  Cases  with  intraoperative  damaqe  and  uncxomplicated  cases  are 
homogeneous  regarding  assignment  by  Body  System  index. 

Hi:  Cases  with  intraoperative  damage  and  uncomplicated  cases  are 
heteroqeneous  regarding  assignment  by  Body  System  index. 

X2  =  4.1  <  Xi^o,95  =  3.84 

Reject  Hg. 
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CHI  SQUARE  TESTS  OF  INDEPENDENCE 


Disease  Stage 

Totals 

0.0-1. 9 

2. 0-2. 9 

3. 0-3.9 

Mortalities 

1  (4.8) 

1  (3.3) 

9  (2.9) 

11 

Nonmortalities 

19  (15.2) 

13  (10.7) 

3  (9.1) 

35 

20 

14 

12 

46 

Hg:  Disease  Staqinq 

index  and  mortality 

outcomes  are 

independent. 

H-) :  Disease  Staging 

index  and  mortality 

outcomes  are 

associated. 

x2  =  23.3  >  X2, 0.995 

=  10.6 

Reject  Hq. 

Body  Systems 

Totals 

1 

2 

3  or  > 

Mortalities 

1  (7.5) 

4  (2.3) 

7  (2.3) 

12 

Nonmor tali ties 

29  (22.5) 

5  (6.8) 

2  (6.8) 

36 

30 

9 

9 

48 

Hq:  Body  System  index  and  mortality  outcomes  are  independent. 
H-]:  Body  System  index  and  mortality  outcomes  are  associated. 
X2  =  22.7  >  X2^o.995  = 
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